Minimization of Information Loss through
نویسنده
چکیده
In this article, we explore the concept of minimization of information loss (MIL) as a a target for neural network learning. We relate MIL to supervised and unsupervised learning procedures such as the Bayesian maximum a-posteriori (MAP) discriminator, minimization of distortion measures such as mean squared error (MSE) and cross-entropy (CE), and principal component analysis (PCA). To deal with unsupervised systems where complex noise is present, we introduce the idea of the signal being well-mixed with the noise. If this holds, minimizing information loss about the pair ((; X i) will proportionately minimise information loss about itself. This situation may hold in early processing stages of complex sensory systems such as the retina in higher mammals.
منابع مشابه
Optimal Capacitor Allocation in Radial Distribution Networks for Annual Costs Minimization Using Hybrid PSO and Sequential Power Loss Index Based Method
In the most recent heuristic methods, the high potential buses for capacitor placement are initially identified and ranked using loss sensitivity factors (LSFs) or power loss index (PLI). These factors or indices help to reduce the search space of the optimization procedure, but they may not always indicate the appropriate placement of capacitors. This paper proposes an efficient approach for t...
متن کاملMinimization of Information Loss through Neural Network Learning
In this article, we explore the concept of minimization of information loss (MIL) as a a target for neural network learning. We relate MIL to supervised and unsupervised learning procedures such as the Bayesian maximum a-posteriori (MAP) discriminator, minimization of distortion measures such as mean squared error (MSE) and cross-entropy (CE), and principal component analysis (PCA). To deal wit...
متن کاملAssembly line balancing to minimize balancing loss and system loss
Assembly Line production is one of the widely used basic principles in production system. The problem of Assembly Line Balancing deals with the distribution of activities among the workstations so that there will be maximum utilization of human resources and facilities without disturbing the work sequence. Research works reported in the literature mainly deals with minimization of idle time i.e...
متن کاملRecent Developments in Fouling Minimization of Membranes Modifed with Silver Nanoparticles
When incorporated in membranes, Ag0 nanoparticles are effective antifouling and antibacterial agents, arising from the presence of Ag+ ions either in solution or adsorbed onto nanoparticles. A vari...
متن کاملPrimal Method for ERM with Flexible Mini-batching Schemes and Non-convex Losses
In this work we develop a new algorithm for regularized empirical risk minimization. Our method extends recent techniques of Shalev-Shwartz [02/2015], which enable a dual-free analysis of SDCA, to arbitrary mini-batching schemes. Moreover, our method is able to better utilize the information in the data defining the ERM problem. For convex loss functions, our complexity results match those of Q...
متن کامل